Explicit solution of relative entropy weighted control
نویسندگان
چکیده
We consider the minimization over probability measures of the expected value of a random variable, regularized by relative entropy with respect to a given probability distribution. In the general setting we provide a complete characterization of the situations in which a finite optimal value exists and the situations in which a minimizing probability distribution exists. Specializing to the case where the underlying probability distribution is Wiener measure, we characterize finite relative entropy changes of measure in terms of square integrability of the corresponding change of drift. For the optimal change of measure for the relative entropy weighted optimization, an expression involving the Malliavin derivative of the cost random variable is derived. The theory is illustrated by its application to several examples, including the case where the cost variable is the maximum of a standard Brownian motion over a finite time horizon. For this example we obtain an exact optimal drift, as well as an approximation of the optimal drift through a Monte-Carlo algorithm.
منابع مشابه
OWA operators with maximal entropy
One important issue in the theory of Ordered Weighted Averaging (OWA) operators is the determination of the associated weights. One of the first approaches, suggested by O’Hagan, determines a special class of OWA operators having maximal Shannon entropy of the OWA weights for a given level of orness; algorithmically it is based on the solution of a constrained optimization problem. In this pape...
متن کاملExtended MULTIMOORA method based on Shannon entropy weight for materials selection
Selection of appropriate material is a crucial step in engineering design and manufacturing process. Without a systematic technique, many useful engineering materials may be ignored for selection. The category of multiple attribute decision-making (MADM) methods is an effective set of structured techniques. Having uncomplicated assumptions and mathematics, the MULTIMOORA method as an MADM appro...
متن کاملRobust coding for a class of sources: Applications in control and reliable communication over limited capacity channels
This paper is concerned with the control of a class of dynamical systems over finite capacity communication channels. Necessary conditions for reliable data reconstruction and stability of a class of dynamical systems are derived. The methodology is information theoretic. It introduces the notion of entropy for a class of sources, which is defined as a maximization of the Shannon entropy over a...
متن کاملRobust Entropy Rate for Uncertain Sources and its Applications in Controlling Systems Subject to Capacity Constraints
The robust entropy rate is defined as the maximum of the Shannon entropy rate, when the joint probability density function of the source is unknown. The uncertainty of the source probability density is described via a relative entropy constraint set between the uncertain source probability density and the nominal source probability density. For this class of problems, the explicit solution for ...
متن کاملExplicit multiple singular periodic solutions and singular soliton solutions to KdV equation
Based on some stationary periodic solutions and stationary soliton solutions, one studies the general solution for the relative lax system, and a number of exact solutions to the Korteweg-de Vries (KdV) equation are first constructed by the known Darboux transformation, these solutions include double and triple singular periodic solutions as well as singular soliton solutions whose amplitude d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Systems & Control Letters
دوره 72 شماره
صفحات -
تاریخ انتشار 2014